System for tracking physical objects

ABSTRACT

Described in detail herein are systems and methods for determining in situ locations of physical objects using mobile devices within a facility. Multiple mobile devices may scan different identifiers of different physical objects disposed in a facility. The mobile devices may transmit the identifiers to a distributed computing system. The distributed computing system may query a database to determine the in situ location of the physical objects associated with the identifiers. In response to not being able to retrieve a in situ location of a physical object, the distributed computing system may determine a path of the mobile device which transmitted the identifier associated with the physical object with the unknown in situ location. The distributed computing system may determine the in situ location of the physical object for which the in situ location was unknown based on the path and the known locations of the other physical objects.

CROSS-REFERENCE TO RELATED PATENT APPLICATIONS

This application claims priority to U.S. Provisional Application No.62/312,002 filed on Mar. 23, 2016, the content of which is herebyincorporated by reference in its entirety.

BACKGROUND

In some environments, it can be important to know the locations at whichobjects are disposed and/or from which objects are removed. Determiningand verifying an original location of physical objects can be difficultparticularly after those physical objects have been removed from theiroriginal location.

BRIEF DESCRIPTION OF DRAWINGS

Illustrative embodiments are shown by way of example in the accompanyingdrawings and should not be considered as a limitation of the presentdisclosure:

FIG. 1A depicts a block schematic diagram of an exemplary computingsystem, in accordance with one embodiment of the present invention;

FIG. 1B depicts an illustration of a mobile device receivingidentification information from an item and communicating with adistributed computing system, in accordance with one embodiment of thepresent invention;

FIG. 1C depicts an illustration of an optical scanning machine readingan optical machine-readable representation of an order display on amobile device, in accordance with one embodiment of the presentinvention;

FIGS. 2A and 2B depict flowchart illustrations of methods, apparatus(systems) and computer program products, in accordance with oneembodiment of the present invention;

FIGS. 3-18 depict various schematic representations of a mobileself-checkout device running a mobile self-checkout application, inaccordance with one embodiment of the present invention;

FIGS. 19, 20 and 21 depict various schematic representations of methods,apparatus (systems) and computer program products, in accordance withone embodiment of the present invention.

FIG. 22 is a block diagrams illustrating scanning of physical objects bya mobile device according to exemplary embodiments;

FIG. 23 illustrates an exemplary network environment for a locationsystem in accordance with exemplary embodiments of the presentdisclosure; and

FIG. 24 is a flowchart illustrating an exemplary process for a trackingsystem in accordance with exemplary embodiments of the presentdisclosure.

DETAILED DESCRIPTION

Described in detail herein are systems and methods for determining insitu locations of physical objects (e.g., original or resting locationsof physical objects) when the in situ locations are unknown. Mobiledevices can execute a terminal sales application. The mobile device, viathe terminal sales application, can scan different identifiers (opticalmachine-readable representations) of different physical objects disposedin a facility and the users of the mobile devices may remove thephysical objects from their in situ location as the physical objects arescanned. The mobile devices may transmit the identifiers, via theterminal sales application, to a distributed computing system, and thedistributed computing system may query a database to determine the insitu location of the physical objects associated with the identifiersscanned via the mobile device. In response to being unable to retrievean in situ location of a physical object, the distributed computingsystem may determine projected paths of the mobile devices based on theidentifiers associated with the physical objects and can use theprojected paths to estimate the in situ location for the physicalobjects having unknown in situ locations. The distributed computingsystem may use the known in situ locations of physical objectsassociated with the other identifiers transmitted by the mobile device.The distributed computing system may determine the in situ locations ofthe physical objects for which the in situ locations were unknown basedon the projected path and the known locations of the other physicalobjects.

In exemplary embodiments, in response to determining an in situ locationof a physical object having an unknown in situ location, the in situlocation is verified to determine whether the in situ location of thephysical object corresponds to an expected location.

The distributed computing system can generate a projected path byplacing data points of scanned identifiers with known in situ locationson a map. The distributed computing system determines and verifies an insitu location by interpolating the in situ location as an added datapoint at a point along the projected path based on, for example, theorder in which the identifiers associated with the physical objects arescanned, overlaying an existing map including an expected in situlocation corresponding to a location at which the at least one physicalobject was expected to be disposed, and determining whether the addeddata point and the overlaid data point correlate with each other.

In exemplary embodiments, in response to determining the in situlocation of a physical object having an unknown in situ location, thedistributed computing system can trigger one or more events. The one ormore events can include, but are not limited to, issuing an alert,storing the determined in situ location of the at least one physicalobject, determining a new in situ location to which like physicalobjects should be moved.

With reference to FIG. 1A, depicted is an exemplary computing system forimplementing embodiments. FIG. 1 includes a computer 100, which could beany one of a mobile device 200 or distributed computing system 240.Computer 100 may be a portable device, wherein at least some or all ofits components are formed together in a single device which can becarried around by a person. The computer 100 includes a processor 110,memory 120 and one or more drives 130. The drives 130 and theirassociated computer readable memory medium provide storage of computerreadable instructions, data structures, program modules and other datafor the computer 100. Drives 130 can include an operating system 140,application programs 150, program modules 160, and program data 180.Computer 100 further includes input devices 190 through which data mayenter the computer 100, either automatically or by a user who enterscommands and data. Input devices 190 can include an electronicdigitizer, a flatbed scanner, a barcode reader, a microphone, a camera,a video camera, a keyboard and a pointing device, commonly referred toas a mouse, a trackball or a touch pad, a pinpad, any USB device, anyBluetooth enabled device, an RFID or NFC device, and a debit cardreader. Other input devices may include a joystick, game pad, satellitedish, scanner, and the like. In one or more embodiments, input devices190 are portable devices that can direct display or instantiation ofapplications running on processor 110.

These and other input devices 190 can be connected to processor 110through a user input interface that is coupled to a system bus 192, butmay be connected by other interface and bus structures, such as aparallel port, game port or a universal serial bus (USB). Computers suchas computer 100 may also include other peripheral output devices such asspeakers, printers, and/or display devices, which may be connectedthrough an output peripheral interface 194 and the like.

Computer 100 also includes a radio 198 or other type of communicationsdevice for wirelessly transmitting and receiving data for the computer100 with the aid of an antenna. Radio 198 may wirelessly transmit andreceive data using WiMAX™, 802.11a/b/g/n, Bluetooth™, 2G, 2.5G, 3G, and4G, wireless standards.

Computer 100 may operate in a networked environment using logicalconnections to one or more remote computers, such as a distributedcomputing system 240. The distributed computing system 240 may be apersonal computer, a server, a router, a network PC, a peer device orother common network node, and may include many if not all of theelements described above relative to computer 100. Networkingenvironments are commonplace in offices, enterprise-wide computernetworks, intranets and the Internet. For example, in the subject matterof the present application, computer 100 may comprise the source machinefrom which data is being migrated, and the remote computer may comprisethe destination machine. Note, however, that source and destinationmachines need not be connected by a network or any other means, butinstead, data may be migrated via any media capable of being written bythe source platform and read by the destination platform or platforms.When used in a LAN or WLAN networking environment, computer 100 isconnected to the LAN through a network interface 196 or an adapter. Whenused in a WAN networking environment, computer 100 typically includes amodem or other means for establishing communications over the WAN, suchas radio 198, to environments such as the Internet. It will beappreciated that other means of establishing a communications linkbetween computer 100 and other computers may be used.

With reference to FIG. 1B, illustrated is an exemplary representation ofa mobile device 200 for purchasing an item 220 from a retailer at aretail establishment. Mobile device 200 includes any portable electronicdevice having a processor 201 for executing applications and a display206 for displaying information connected with the processor 201, andincludes such devices as a personal desktop assistant (PDA), a portablecomputer, a mobile telephone, a smartphone, a netbook, and a tabletcomputer. Display 206 can use any of a variety of types of displaytechnologies, such as a liquid crystal display (LCD), a cathode-ray tubetype display, an electronic ink display, a light emitting diode (LED)type display such as an OLED display, and a plasma display. Preferably,the mobile device 200 also includes a communications device 208 and anoptical reader 202. The communications device 208 is connected with theprocessor 201 and capable of sending and receiving information betweenone or more other computers connected with the mobile device 200.Preferably, communications device 208 is capable of wirelesslytransmitting signals to another computer, such as distributed computingsystem 240, using a radio transmitter and a radio receiver connectedwith an antenna. The optical reader 202 is capable of receivingidentification information 222 from an item 220 and converting theidentification information 222 into a format that the processor 201 canread, such as digital data. Preferably, Optical reader 202 includes anydevice which can capture, receive and process optical information, suchas a barcode or any image, and includes devices such as a digitalscanner, a digital camera, a video camera, a barcode reader, and anyother type of digital or analog imaging device.

Preferably, communications device 208 communicates with another computer100, such as distributed computing system 240, via a network 226 using anetwork interface 209. Network interface 209 is connected with processor201 and communications device 208, and preferably disposed within remotedevice 200.

Network 226 may include any type of network that is capable of sendingand receiving communication signals, including signals for multimediacontent, images, data and streaming video. Network 226 may include adata network, such as the Internet, an intranet, a local area network(LAN), a wide area network (WAN), a cable network, and other likesystems that are capable of transmitting information, such as digitaldata, and the like. Network 226 may also include a telecommunicationsnetwork, such as a local telephone network, long distance telephonenetwork, cellular telephone network, satellite communications network,cable television network and other like communications systems thatinteract with computer systems to enable transmission of informationbetween mobile device 200 and another computer such as distributedcomputing system 240. Network 226 may include more than one network andmay include a plurality of different types of networks. Thus, network226 may include a plurality of data networks, a plurality oftelecommunications networks, cable systems, satellite systems and/or acombination of data and telecommunications networks and other likecommunication systems.

Network 226 is connected with both mobile device 200 and distributedcomputing system 240 and allows for information to be transmitted andshared between mobile device 200 and distributed computing system 240.Distributed computing system 240 includes any type of computer which canreceive, store, process, and transmit information to another computerand includes devices such as a server based computer system capable ofinteracting with one or more other computer systems.

In one embodiment, mobile device 200 includes location informationprocessing means which allows the mobile device 200 to determine itslocation. Location information processing means includes devices such aGlobal Positioning System (GPS) based device, and methods such as usingradio triangulation to determine the location of the mobile device 200.Preferably, mobile device 200 includes input means 210 for enteringinformation from a user into the mobile device 200. Input means includesany device which can assist a user to enter information, such as akeyboard, a mouse, a touchpad, a touchscreen, a joystick, a button, anda dial.

Item 220 includes any item or service which is being sold by a retailer.Preferably, the item 220 is located with a retail establishment orstore. Item 220 includes item identification information 222 which isany information on the item 220 which assists in identifying the item220, such as a barcode 224, a serial number, a name of the item 220, andany text, characters, illustrations, or images on the item 220 which canbe used to identify the item 220.

In some embodiments, the distributed computing system 240 can include apath generating module, a location finder module and an event module.The path generating module, the location finder module and the eventmodule will be discussed in further detail with respect to FIG. 23.

With reference to FIGS. 2A and 2B, in operation, the mobile device 200is brought into a retail establishment by a customer, or user, and amethod 300 for self-checkout with the mobile device 200 is initiated bylaunching a mobile self-checkout application 400 within the mobiledevice 200 at block 302. Mobile self-checkout application 400 resides onthe mobile device 200 and communicates with a terminal sales application620 which resides on the server 240. Upon launching the mobileself-checkout application 400, the user may be first prompted toidentify himself/herself by entering user identification informationinto the mobile device 200 via the input means 210. User identificationinformation may include a username, a password, both a username andpassword. If user is launching the mobile self-checkout application 400for the first time, the user may be prompted to enter additional userinformation in addition to user information. Additional user informationincludes any information which may be used to identify a user, such asuser's name, a user's address, a user's telephone number, a user'scredit card information or other user financial information, a user'ssocial security number, a user's driver's license number, a user'sbirthdate, a user's passport number, and other identifying informationwhich may or may not be stored by mobile device 200 or distributedcomputing system 240.

Upon identifying the user, the method 300 then moves to block 306 wheremobile device 200 is connected with a computer at the retailestablishment, such as distributed computing system 240, via network226. Upon connecting mobile device 200 with distributed computing system240, the method 300 then moves to block 308 and the user begins shoppingat the retail establishment by walking around the retail establishmentand looking for items 220 to purchase. With reference to FIGS. 3 and 18,a home screen 402 is presented to the user by the mobile self-checkoutapplication 400 upon launching the mobile self-checkout application 400and entering user information. In one embodiment, the home screen 402includes a local ad button 404 which can provide the user withadvertisements specific to the retail establishment in which the user isin, a begin shopping button 406 which allows the user to communicate hisintention to begin shopping to the mobile self-checkout application 400and presents the user with a shopping screen 418, and an order historybutton 408 which allows the user to review past orders, purchases, orpast virtual shopping carts. Additionally, the home screen 402 maydisplay store identifying information 410 which provides informationthat identifies the specific retail establishment in which the user isin, for example, by stating the city and state in which the retailestablishment is in or a store number for the retail establishment.Preferably, the mobile device 200 uses the location informationprocessing means to determine the store identifying information 410.

With reference to FIG. 18, in one embodiment, the home screen 402includes a cart button 403, which when selected, presents the user witha shopping cart screen 430, as shown in FIG. 8. In one embodiment, thehome screen 402 includes a help button 405, which when selected,presents the user with a series of help screens which aid the user inusing the mobile self-checkout application 400.

Additionally, mobile self-checkout application 400 includes a scan itemsbutton 412, a view cart button 414, and a home button 416. Preferably,buttons 412, 414, and 416 are all present on all or almost all of thescreens of the mobile self-checkout application 400, as show in FIGS.3-15. When selected, the scan items button 412 activates the opticalreader 202 and presents the user with a scan items screen 420, as shownin FIG. 5, which allows the user to capture and input identificationinformation 222 from an item 220. When selected, the view cart button414 presents the user with a shopping cart screen 430, as shown in FIG.8, which allows the user to view the contents of a virtual shopping cart433 created by the user and which contains item information 432representing the item 220. When selected, the home button 416 returnsthe user to the home screen 402.

With reference to FIG. 16, in one embodiment, mobile self-checkoutapplication 400 includes a my store button 417 in addition to the scanitems button 412, the view cart button 414, and the home button 416.When selected, the my store button 417 presents the user with a storeinformation screen generated by mobile self-checkout application 400which displays information about the retail establishment that the useris in. Specifically, the store information screen displays informationincluding but not limited to an address of the retail establishment, aphone number of the retail establishment, hours of operation for theretail establishment, services and store number for the retailestablishment, and other such information. Preferably, the my storebutton 417, when selected, also determines the geographic location ofthe retail location using location information processing means.

Preferably, once the user has begun shopping at the retailestablishment, as shown in block 308, the user communicates hisintention to begin shopping to the mobile self-checkout application 400,such as by activating the begin shopping button 406 on the home screen402. With reference to FIGS. 4 and 7, when selected, the begin shoppingbutton 406 presents the user with a shopping screen 418 having a scanproduct barcode button 422, a manual identification information box 424,a checkout button 426, subtotal information 428, total information 434,and a partial virtual shopping cart contents window 436. The scanproduct barcode button 422 activates the optical reader 202 and presentsthe user with a scan items screen 420, as shown in FIG. 5. The manualidentification information box 424 allows a user to manually inputidentification information 222 into the mobile device 200 whichidentifies the item 220 for purchase, by inputting, for example, aUniversal Product Code (UPC) for the item 220. In one embodiment, UPCinformation is either manually input or determined automatically fromthe scan of identification information 222 and then transmitted bymobile device to distributed computing system 240 where a UPC lookupsystem resides which uses the UPC information to provide the user withitem information 432. When selected, the checkout button 426 presentsthe user with a checkout screen 450, as shown in FIG. 9, which presentsthe user with the total contents of the virtual shopping cart 433 andthe option to confirm the user's intention to purchase those contents.The subtotal information 428 presents the user with a subtotal amountfor the contents of the virtual shopping cart 433, and the totalinformation 434 presents the user with a total amount for the contentsof the virtual shopping cart 433. The partial virtual shopping cartcontents window 436 display a partial view of the contents of thevirtual shopping cart 433, such as the last the items entered into thevirtual shopping cart 433.

Upon spotting an item to purchase, method 300 then moves to block 310,wherein the user then takes and removes the item 220 from a shelf orstand within the retail establishment. Moving to block 312, the userthen inputs identification information 222 into the mobile device 200which identifies the item 220 for purchase. The identificationinformation 222 can be input manually, such as by entering theinformation 222 into the identification information box 424, or theidentification information 222 can be automatically input by scanningthe information 222 using optical reader 202. The user may automaticallyinput identification information 222 by activating optical reader 202.For example user may by activating optical reader 202 by either pressingscan product barcode button 422 or scan items button 412, either ofwhich activates the optical reader 202 and presents the user with a scanitems screen 420, as shown in FIG. 5. At scan items screen 420, the userinitiates optical reader 202 which then receives identificationinformation 222 from an item 220 and converts the identificationinformation 222 into a format, such as a digital image, so that theprocessor 201 can read and process the identification information 222.In processing identification information 222, processor 201 may useoptical character recognition (OCR) algorithms in order to determineidentification information 222 such as a barcode number or a UPC for theitem 220.

Upon inputting identification information 222 into the mobile device200, the identification information 222 is transmitted to thedistributed computing system 240 via communications device 208 andreceived by the distributed computing system 240 at block 314. Thedistributed computing system 240 may then, at block 314, retrieve iteminformation 432 representing the item 220 using the identificationinformation 222 received from the mobile device 200. The iteminformation 432 may include an item name, an item price, an item review,an item rating, item product details which is a description of the item220, an image of the item 220, an item tax amount or percentage, or itemlocation information as to where the item 220 is located in the retailestablishment.

Upon retrieving item information 432, the distributed computing system240 may then transmit the retrieved item information 432 to the mobiledevice, whereupon mobile self-checkout application 400 may present theuser with an item information screen 440 which displays item information432 for item 220, as shown in FIGS. 6 and 12. In one embodiment, theuser may be prompted to confirm that the item information 432 is relatedto the item 220 for purchase. Moving to block 316, the user may also beprompted to confirm the user's intent to purchase an item identified byitem information 222. For example, the item information 222 may be foran item which is not item 220 selected by the user. In this case theuser can inform the mobile self-checkout application 400 that the iteminformation 222 is not accurate or does not relate to item 220.

With reference to FIGS. 6 and 12, in one embodiment, item informationscreen 440 provides the user with an add to shopping cart button 442 ora quantity select button 443 which when selected, generates a virtualshopping cart 433 containing item information 432 representing the item220. The quantity select button 443 allows the user to add more than oneitem 220 in the virtual shopping cart 433 and then an update quantitybutton 445 allows the user to update the quantity of item 220 indicatedby the virtual shopping cart 433. Additionally, the user may also beprovided with a cancel and scan again button 444, which when selected,does not add item information 432 to a virtual shopping cart 433 andprovides the user with the scan items screen 420 again. In oneembodiment, a remove item button 447 is provided to the user, which whenselected, removes the any item information 222 for item 220 from thevirtual shopping cart 433. With reference to FIG. 13, if the remove itembutton 447 is selected, the user may be prompted with an item removalconfirmation screen 480 which prompts the user to confirm his/her desireto remove item 220 along with item information 222 from virtual shoppingcart 433.

With reference to FIG. 16, in one embodiment, item information screen440 provides the user with the option 419 to rate the item 220 and readreviews from other users for the item 220. In one embodiment, mobileself-checkout application 400 provides the user with the option toprovide stock information to the distributed computing system 240indicating whether or not item 220 is in stock at the retailestablishment.

If the user confirms his/her intent to purchase item 220, a virtualshopping cart 433 containing item information 432 representing the item220 is then generated at block 318. In one embodiment, the virtualshopping cart 433 is generated by the mobile device 200 and thentransmitted to the distributed computing system 240. In anotherembodiment, the virtual shopping cart 433 is generated by thedistributed computing system 240 and specifically, generated by theterminal sales application 620. Preferably, the virtual shopping cart433 is generated by the distributed computing system 240, specificallygenerated by the terminal sales application 620, stored on thedistributed computing system, and transmitted to the mobile device 200for display to the user via display 206. Preferably, any contents in thevirtual shopping cart 433, which represent items 220, are kept in thevirtual shopping cart 433 for a predefined period of time, after whichthe contents are deleted. If the method 300, and the shopping process,is interrupted for any reason (for example a phone call is received bythe mobile device 200, a text message is received by the mobile device200, the user wishes to perform another function with the mobile device200, etc.) the user can resume the method 300 and continue using thevirtual shopping cart 433 representing the already selected items 220for a predefined period of time. In one embodiment, mobile self-checkoutapplication 400 provides the user with the option to create and save ashopping list having all the items 220 represented in the virtualshopping cart 433. The shopping list can be created any place, such as auser's home. When using the shopping list in a retail establishment aspart of method 300, items 220 may be paired up and removed from theshopping list and then added to the virtual shopping cart 433.

In one embodiment, upon retrieving item information 432, the distributedcomputing system 240 may then transmit the retrieved item information432 to the mobile device, whereupon mobile self-checkout application 400may automatically generate a virtual shopping cart 433 containing iteminformation 432 representing the item 220. Additionally, in oneembodiment, upon retrieving item information 432, the distributedcomputing system 240 may automatically generate a virtual shopping cart433 containing item information 432 representing the item 220 andtransmit that shopping cart along with its contents to the mobile device200 for display to the user.

Upon generating a virtual shopping cart 433 containing item information432 representing the item 220 and transmitting that information betweenthe mobile device 200 and the distributed computing system 240, themobile device 200 then displays a virtual shopping cart 433 along withall of its contents 435 to the user at block 320. In one embodiment, themobile self-checkout application 400 presents the user with the shoppingcart screen 430, as shown in FIG. 8, displaying the contents of thevirtual shopping cart 433 to the user using item information 432.

With reference to FIGS. 8 and 17, the shopping cart screen 430 maypresent the user with the option to purchase the item 220 represented byitem information 432 in the virtual shopping cart 433 by pressing acheckout button 439 or a prepare to pay button 437. The shopping cartscreen 430 may present the user with the option to continue shopping bypressing a back button 434, wherein the user is presented with theshopping screen 418 again. The shopping cart screen 430 may also presentthe user with the option to cancel an order 452 altogether by pressing acancel order button 438, wherein the contents of the virtual shoppingcart 433 are emptied and the user is presented with either the shoppingscreen 418 or the home screen 402 again. With reference to FIG. 15, inone embodiment, when the cancel order button 438 is selected, the usermay be prompted with an order cancellation screen 490 which prompts theuser to confirm his/her desire to cancel order 452 and empty the virtualshopping cart 433.

As used herein, an order 452 is any request to purchase an item 220.Order 452 is comprised of information received from the mobileself-checkout program 400, such as identification information 222,quantity information indicating how many units of a particular item 220in the virtual shopping cart 433 a user would like to purchase, useridentification information, additional user information, an order number463, and store identifying information 410 which provides informationthat identifies the specific retail establishment in which the user isin.

With reference to FIG. 14, in one embodiment, the shopping cart screen430 includes an item removal button 431 associated with each item 220represented in the virtual shopping cart 433. When the item removalbutton 431 is selected, the user may be prompted with item removalconfirmation screen 480 which prompts the user to confirm his/her desireto remove item 220 along with item information 222 from virtual shoppingcart 433, as shown in FIG. 13.

Upon displaying the contents of the virtual shopping cart 433 to theuser at block 320, the user then places the item 220 in an actualshopping cart at block 322. The user is then prompted by the mobileself-checkout application 400 at block 324 and asked if the user wouldlike to continue shopping and purchases additional items 220 or not. Inone embodiment, the user is presented with checkout button 439, backbutton 434, and/or cancel order button 438. If the user wishes tocontinue shopping, method 300 moves back to block 310. If the user doesnot wish to continue shopping, method 300 moves to block 326, whereinthe user selects the option of checking out, using for example checkoutbutton 439. In one embodiment, instead of pressing a button, such ascheckout button 439, back button 434, and/or cancel order button 438,the user may make a hand gesture, a swipe, or other such gesture toactivate a feature of mobile self-checkout application 400.

Upon selecting the option to checkout, a total amount for all thecontents of the virtual shopping cart 433 is calculated and an order 452is generated for the item 220 identified by the identificationinformation 222, listed in the virtual shopping cart 433 at block 328.Preferably, an order number 463 associated with the order 452 is alsogenerated. In one embodiment, the order 452 is generated by the mobiledevice 200 and transmitted to the distributed computing system 240, inanother embodiment the order 452 is generated by the distributedcomputing system 240 and then transmitted to the mobile device 200 forconfirmation by the user. Upon generating the order 452 at block 328,the user is then presented with the order 452 at block 330 and asked toconfirm the accuracy of the order 452. Preferably, an order confirmationscreen 450 is generated by the mobile self-checkout application 400, asshown in FIG. 9. The order confirmation screen 450 includes a confirmbutton 454 which allows the user to confirm the accuracy of the order452 and the user's intent to purchase the items 220 identified in theorder 452 via identification information 432. The order confirmationscreen 450 also includes a back button 456 which when pressed allows touser to go back to the shopping cart screen 430.

Upon confirming a user's intent to purchase items 220 identified by iteminformation 432, method 300 then moves to block 332 wherein the userselects the type of tender and the payment method used to pay for theorder 452 which was generated. The user has the choice of providing avariety of types of tender, such as cash, credit card, direct debit froma bank, payment using an online payment service such as PayPal™ orGoogle Checkout, a gift card, store credit, personal check, money order,or other payment means. The user also has the choice of payment method,either transmitting payment via the mobile device 200 using mobileself-checkout application 400 or providing payment at either atraditional cashier or self-checkout station.

If the user decides to provide payment for order 452 using a traditionalcashier or self-checkout station, which may occur when the user wishesto pay with cash, then a virtual transaction is created at block 342 andan optical machine-readable representation 460 of the order 452 whichidentifies the order 452 is generated and displayed on the display 206of the mobile device 200 at block 344. The optical machine-readablerepresentation 460 encodes a unique identifier 462 such as an ordernumber 463 or a unique mobile identifier (UMI) which is associated withthe mobile device 200 in order to identify order 452, since each opticalmachine-readable representation 460 generated is unique to each order452. Each unique mobile identifier (UMI) is specific to a particularmobile device 200, and contains information identifying that particularmobile device 200, such as unique device identifier (UDID) for themobile device 200, a serial number of the mobile device 200, or someother identifying information for a particular mobile device 200.

The optical machine-readable representation 460 of the order 452represents the order 452 and encodes identifying information or a uniqueidentifier 462, which includes things such as: an order number 463;customer identifying information which can be used to identify acustomer, such as a customer name, a customer number, and a socialsecurity number; transaction identifying information which can be usedto identify a specific transaction, such as a number or otheralphanumeric code; device identifying information that can identify aspecific device such as a serial number or a unique device identifier(UDID) for a device such as a mobile phone or mobile computer; and anyalphanumeric code or any symbol which may be used associated with andused to identify and retrieve a specific order 452. Preferably, an ordernumber 463 along with the optical machine-readable representation 460 ofthe order 452 is displayed on the display 206 of the mobile device 200.

The optical machine-readable representation 460 of the order 452 isencoded in such a manner as to allow an optical scanning machine 500,such as barcode reader, to read the optical machine-readablerepresentation 460. A barcode reader, or barcode scanner, is anelectronic device for reading printed barcodes. Like a flatbed scanner,a barcode reader consists of a light source, a lens, and a light sensortranslating optical impulses into electrical ones. As a result, theoptical machine-readable representation 460 of the order 452 ispreferably in a form of barcode, such as a linear or 1D barcode, or amatrix 2D barcode, allowing for a standard barcode reader to read andconvert the optical machine-readable representation 460 into digitaldata which any computer can read. In one embodiment, the opticalmachine-readable representation 460 of the order 452 is preferably in aform of 1D barcode, such as a 1D barcode having one of the followingformats: UPC-A, UPC-E, EAN-13, EAN-8, Code-128, Code-39 and ITF.

Preferably, upon generating the optical machine-readable representation460 of the order 452, a machine-readable representation screen 458 isgenerated by the mobile self-checkout application 400, as shown in FIG.10. The machine-readable representation screen 458 includes an ordernumber 463 along with the optical machine-readable representation 460 ofthe order 452, a total payment amount 464 for all the items 220 ordered,and a total amount 466 of items 220 sold. The user is directed by themobile self-checkout application 400 to present the opticalmachine-readable representation 460 to a cashier to scan in order tocomplete a checkout process via message 468 on machine-readablerepresentation screen 458 at block 346. In one embodiment, a uniqueidentifier 462 is provided to the user and displayed on display 206,either alone or printed below the optical machine-readablerepresentation 460. In this embodiment, the user may manually input orkey in the unique identifier 462 at a point of sale terminal 600 orprovide the unique identifier 462 to a cashier who then can manuallyenter the unique identifier 462 at the point-of-sale terminal 600.

With reference to FIGS. 1C and 2B, at block 348, the user goes to atraditional cashier or a self-checkout station and presents the opticalmachine-readable representation 460 to an optical scanning machine 500which reads the optical machine-readable representation 460, andspecifically the unique identifier 462 encoded in the opticalmachine-readable representation 460. Preferably, the unique identifier462 is then transmitted to distributed computing system 240 in order toretrieve the order 452 from the distributed computing system 240. Order452, along with the total payment amount 464, is then transmitted fromthe distributed computing system 240 to a cash register or othercomputer operable by the traditional cashier or the self-checkoutstation. Moving to block 348, the user is then prompted by either thetraditional cashier or the self-checkout station to tender payment forthe total payment amount 464, whereupon the user then tenders payment toeither the traditional cashier or the self-checkout station for thetotal payment amount 464.

Moving the block 336, upon the user tendering payment, paymentinformation is generated by the cash register or other computer operatedby the traditional cashier, or by the self-checkout station and thentransmitted to the distributed computing system 240, whereupon thevirtual shopping cart 433 is then marked paid and a receipt is generatedby the distributed computing system 240, the traditional cashier, and/orthe self-checkout station. The receipt is then provided to the user.

Preferably, an acknowledgment that payment has been received is sent tothe mobile device 200 from the distributed computing system 240 anddisplayed to the user via a payment received screen 458 which isgenerated by the mobile self-checkout application 400, as shown in FIG.10. In one embodiment, a digital copy of the receipt is transmitted tothe user from the distributed computing system 240. Preferably, thedigital copy of the receipt is transmitted from the distributedcomputing system 240 to the mobile device 200 and displayed via themobile self-checkout application 400. In one embodiment, the digitalcopy of the receipt is transmitted from the distributed computing system240 in an email to an email address of the user. Preferably, upongenerating and sending an acknowledgment that payment has been received,the server 240 then changes the current virtual shopping cart into apast virtual shopping cart, retrievable by the user via the orderhistory button 408. Sales transaction and receipt information is storedon the distributed computing system 240 and is thus accessible for avariety of purposes: including but not limited to: asset protectionsolutions, return validation, customer reference, and the like.

If at block 332 the user decides to provide payment for order 452 bytransmitting payment via the mobile device 200 using mobileself-checkout application 400, then application 400 either debits apreregistered payment account of the user's or the user is prompted forpayment account information. If the user has already created apreregistered payment account with mobile self-checkout application 400,by already entering payment account information which could include,credit card information, online payment service information such as auser account name and password, store credit information, or gift cardinformation, then mobile self-checkout application 400 debits thepreregistered account at block 334. If the user has not already createda preregistered payment account with mobile self-checkout application400, the user is prompted to create a payment account by providingpayment account information. Upon creating the payment account, themobile self-checkout application 400 then debits the payment account forthe total payment amount 464. Upon debiting either the preregisteredpayment account or the just created payment account, the method 300 thenmoves to block 336, whereupon the whereupon the virtual shopping cart433 is then marked paid and a receipt is generated by the distributedcomputing system 240, the traditional cashier, and/or the self-checkoutstation. The receipt is then provided to the user. Sales transaction andreceipt information is stored on the distributed computing system 240and is thus accessible for a variety of purposes: including but notlimited to: asset protection solutions, return validation, customerreference, and the like.

Moving to block 338, upon marking that the virtual shopping cart 433 ispaid, mobile self-checkout application 400 is terminated and the userexits the retail establishment at block 340.

With reference to FIGS. 19, 20 and 21, a terminal sales application 620for maintaining and conducting a virtual transaction is shown. Terminalsales application 620 includes a session manager 650 in communicationwith a Virtual Terminal Sales Application (VTSA) 640 and a transactionstate container 660. A virtual transaction contains all of theinformation found within order 452 or virtual shopping cart 433, but isconducted entirely with an application, such as a VTSA 640 run withinterminal sales application 620. Unlike real transactions which areprocessed on a point of sale terminal 600 having peripheral devices, avirtual transaction is processed with an application which mimics thefunctionality of a point of sale terminal 600 and is run on a computerwhich lacks the peripheral devices point of sale terminal 600. Terminalsales application 620 resides on a computer, such as distributedcomputing system 240, and interacts with mobile self-checkoutapplication 400.

With reference to FIG. 19, terminal sales application 620 communicateswith mobile self-checkout application 400 by receiving requests viaPoint of Sale (POS) messages 630 from the mobile self-checkoutapplication 400 and by transmitting POS message 630 back to the mobileself-checkout application 400. POS messages 630 are messages whichcontain point-of-sale purchase information, such as Point of SaleBusiness Component messages used by point of sale terminals such as IBM™Self Checkout Systems. In particular, session manager 650 of terminalsales application 620 communicates with mobile self-checkout application400 by sending and receiving POS messages 630. POS messages 630 receivedby terminal sales application 620 contain a request to processinformation required for order 452, such as identification information222, quantity information indicating how many units of a particular item220 in the virtual shopping cart 433 a user 610 would like to purchase,user identification information, additional user information, an ordernumber 463, store identifying information 410 which provides informationthat identifies the specific retail establishment in which the user isin, and a unique identifier 462 which identifies a specific virtualtransaction, such as an order number 463 or a unique mobile identifier(UMI).

Each virtual transaction created or processed by terminal salesapplication 620 has a unique identifier 462 associated with it whichidentifies a specific order 452. The unique identifier 462 may be anorder number 463 or a piece of identifying information which identifiesa specific user 610 or a specific mobile device, such as a unique mobileidentifier (UMI) or a user name or ID number. In one embodiment, theunique identifier 462 is a unique mobile identifier (UMI). Byassociating a unique identifier 462 with a specific virtual transaction,virtual transactions can be identified for each user 610 or mobiledevice 200 interacting with terminal sales application 620.Additionally, each POS message 630 received or transmitted by theterminal sales application 620 also includes a unique identifierassociated with a virtual transaction. In this manner, each POS message630 can be associated with and applied to the virtual transaction it wasintended for.

Session manager 650 transmits and receives POS messages 630 to and fromthe mobile self-checkout application 400, and communicates the POSmessages 630 to the VTSA 640. Additionally, session manager 650interacts with a transaction state container 660 and communicatestransaction state information 642 between the transaction statecontainer 660 and the VTSA 640. Preferably, session manager 650 receivesand prioritizes POS messages 630 received from mobile self-checkoutapplication 400 in a queue and determines when a POS messages 630 iscommunicated to a given VTSA 640 and which VTSA 640 to communicate agiven POS messages 630 to. Each time a POS message 630 is received fromthe mobile self-checkout application 400, the POS message 630 is routedby session manager 650 to an open session of an available VTSA 640within terminal session manager 620. The unique identifier 462 embeddedwithin POS message 630 is used by session manager 650 to locatetransaction state information 642 associated with that unique identifier462 used to conduct the virtual transaction for user 610. Thetransaction state information 642 is then sent by the session manager650 to the VTSA 640 to which the POS message 630 having the same uniqueidentifier 462 was routed, and then the session manager 650 instructsthe VTSA 640 to start or further modify the virtual transaction for user610. Preferably, session manager 650 can access an open session of aVTSA 640 from any one of a plurality of VTSAs 640 running withinterminal sales application 620.

VTSA 640 is an application which represents a virtual point of saleterminal and is run on a computer, such as distributed computing system240. VTSA 640 mirrors the functions of a traditional terminal salesapplication run on a point of sale terminal 600 without requiring theassociated peripheral devices of a traditional point of sale terminal600, such as a scanner or a bar code scanner, a receipt printer, acredit card reader, a cash dispenser, a customer display, an operatordisplay, and other peripheral devices. Preferably, terminal salesapplication 620 includes a plurality of VTSAs 640, each of which isrunning a session. By operating a plurality of VTSAs 640 all within asingle terminal sales application 620, substantial cost and money may besaved by not having to purchase multiple dedicated hardware devices,such as traditional point of sale terminals 600, each running only asingle instance of a terminal sales application.

Each VTSA 640 maintains a virtual transaction by generating andmaintaining transaction state information 642 associated with eachvirtual transaction using a unique identifier 462. Since none of theperipheral devices associated with a traditional point of sale terminal600 are required, multiple VTSAs 640 can run simultaneously on ageneral-purpose computer, such as distributed computing system 240, in avirtual environment which simulates a traditional point of sale terminal600 at less cost. Since multiple point of sale terminals 600 can bereplaced in-part by a single computer, such as distributed computingsystem 240, running multiple instances of VTSA 640, such as VTSA-1 640,VTSA-2 640, VTSA-3 640, as shown in FIG. 19, significant cost savingscan be incurred by using VTSAs 640 in addition to added flexibility withhow the virtual transaction can be crated and maintained.

Every time a virtual transaction is created or modified in any way, forexample when the user 610 creates a virtual shopping cart 433 inmobile-self checkout application 400 or adds items 220 to the virtualshopping cart 433, a POS message 630 is transmitted from mobile-selfcheckout application 400 to session manager 650. POS messages 430received by session manager 650 are then put in a queue with anassociated priority. Typically, POS messages 430 are prioritized in theorder they were received. As a session of a VTSA 640 becomes availableor open, the session manager 650 can access the open session and loadtransaction state information 642 along with a particular POS message430 into the open session of VTSA 640. The VTSA 640, upon receiving thetransaction state information 642 and the POS message 630, acts upon thecontents of the POS message 630 and updates the transaction stateinformation 642 associated with that particular POS message 430. Forexample, if a particular POS message 430 includes information that anadditional item 220 has been added to a user 610's virtual shopping cart433, then the transaction state information 642 associated with thatparticular POS message 430 is updated to reflect this new information.

Every time a POS message 430 is received by an open session of VTSA 640,transaction state information 642 associated with the POS message 430 isretrieved from the transaction state container 660 and transmitted tothe same open session of VTSA 640. Transaction state information 642defines the current state of a virtual transaction, and includesinformation such as a listing of every item 220 in virtual shopping cart433 or specific virtual transaction, item information 432 for each item220 in virtual shopping cart 433 or specific virtual transaction,quantity information indicating how many units of a particular item 220in the virtual shopping cart 433 or specific virtual transaction a user610 would like to purchase, user identification information, additionaluser information, an order number 463, store identifying information 410which provides information that identifies the specific retailestablishment in which the user is in, and a unique identifier 462 whichidentifies a specific user, such as a unique mobile identifier (UMI),amount totals for all the items 220 in virtual shopping cart 433 orspecific virtual transaction, tax information for items 220 in virtualshopping cart 433 or specific virtual transaction, a receipt, a receiptidentifier, and any other information or data that VTSA 640 may requireto process a virtual transaction.

Transaction state information 642 associated with a unique identifier462 changes each time a POS message 430 having that same uniqueidentifier 462 is received by a user 610 or transmitted to a user 610 bysession manager 650 using VTSA 640. Once a virtual transaction has beenprocessed by the VTSA 640, any change in the transaction stateinformation 642 is saved by VTSA 640 in the transaction state container660 and the transaction state information 642 is exported from the VTSA640. New transaction state information 642 for another virtualtransaction is then imported into and opened by VTSA 640. By constantlyimporting and exporting transaction state information 642 uponprocessing each received POS message 630, a terminal sales application620 can using multiple VTSAs 640 to maintain virtual transactions for alarge number of users 610. For example, ten VTSAs 640, can manage andprocess as many as hundreds of virtual transactions, each with their ownunique transaction state information 642, since not all of the virtualtransactions need be active at any given time.

By importing, changing, and then exporting the transaction stateinformation 642 each time a POS message 630 is received from a mobiledevice 200, instead of just keeping transaction state information 642constantly open, the VTSA 640 allows the server 240 to support moreusers 610 and ultimately more orders 452. The process of being able toimport and export the transaction state for each VTSA 640 by sending andreceiving a unique identifier 462 is also known as transaction transfer,as opposed to a suspend/retrieve transaction which reprocesses everyitem in a virtual shopping cart. Transaction transfer allows for a realtime import and export of the transaction state for each VTSA 640.

If the session manager 650 did not use transaction transfer, users 610would be limited to the number of sessions of VTSA 640 running on theserver 240 since each mobile user 610 would be statically connected toan instance of a VTSA 640 until the order 452 was complete. If, forexample, ten sessions were running on the distributed computing system240, then distributed computing system 240 would only be able to handlethe virtual transactions of only ten mobile users 610 at one time.

Using transaction transfer allows the session manager 650 to import thetransaction state information 642, if it exists for a specific virtualtransaction, to an open session of a VTSA 640, process the currentrequest within POS message 630 (such as adding another item 220 to auser 610 s virtual shopping cart 433), save and export the transactionstate information in a storage device or drive 130 by associated thevirtual transaction or order 452 with a unique identifier 462, and thenfree that session of VTSA 640 up for the next mobile user 610. Thisallows the distributed computing system 240 to support many users 610having many virtual transactions using only a limited number of, such asten, sessions of VTSA 640 running on the server 240. Response time isthe only variant, as opposed to being blocked until another user 610 isfinished shopping.

Upon updating the transaction state information 642 associated with aparticular POS message 430, a new POS message 630 is generated by theVTSA 640 and sent to the session manager 430. Depending on transactionstate information 642, the POS message 630 is either routed back to themobile device 200 and the mobile-self checkout application 400 or to apoint of sale terminal 600. For example, if a user 610 has completedshopping and decided to transmit payment via the mobile device 200, orif the user is still shopping and adding items to the virtual shoppingcart 433, then POS message 630 is routed back to the mobile device 200.However, if the user 610 has completed shopping and decided to transmitpayment via a traditional cashier or self-checkout station, then POSmessage 630 is routed to point of sale terminal 600 whereupon the user610 provides identifying information, such as a unique identifier 462 oroptical machine-readable representation 460, to the point of saleterminal 600 and payment for order 452 is processed.

With reference to FIG. 21, transaction state information 642 can bemaintained within distributed computing system 240, transferred toanother distributed computing system 240 at another retailestablishment, transferred to a home office server 790, or transferredto an enterprise server 800 and maintained at an enterprise level foraccess by multiple distributed computing systems at multiple retailestablishments across an enterprise. In one embodiment, POS messages 630can be received by a terminal sales application 620 running in anenterprise server 800 at the enterprise level, from a multitude ofsources, such as a mobile shelf-checkout application 400 running on amobile device 200, a point of sale terminal 600, a user accessing awebsite on the Internet, or from a web-based application running on abrowser. In this manner, a virtual transaction can be maintained andmodified from a plurality of POS messages 630 arriving from a multitudeof sources. As a result, a first POS message 630 related to a particularvirtual transaction may be generated by a mobile shelf-checkoutapplication 400 running on mobile device 200 and a second POS message630 related to the same transaction may be generated by a user accessinga website. For example, a first item 220 can be added to a virtualshopping cart 433 (represented by a particular virtual transaction) viamobile self-checkout application 400, and a second item 220 can be addedto the same virtual shopping cart 433 via a user accessing a website.

In one embodiment, a virtual transaction representing a gift registryhaving a first item 220 and a second item 220 is generated. A first user610 may purchase and pay for the first item 220, using a first method ofpurchase, such as for example the mobile self-checkout application 400,and a second user 610 can purchase and pay for the second item 220 usinga second method of purchase, such as for example a website. Methods ofpurchase include mobile self-checkout application 400, a point of saleterminal 600, web-based applications, or information sent via a website.

In one embodiment, a first user 610 may purchase and pay for a firstportion of a first item 220, using a first method of purchase, such asfor example the mobile self-checkout application 400, and a second user610 can purchase and pay for a second portion of first item 220 using athe first method purchase or a second method of purchase, such as forexample a website. A portion of an item 220 refers to a portion of thepurchase price of the item 220. For example, if a purchase price of thefirst item 220 is $500, the first user 610 may pay for a $200 portion ofthe $500 purchase price and a second user may pay for a $300 portion ofthe purchase price, completing the transaction.

In one embodiment, if a user 610 decides to provide payment for order452 using a point of sale terminal 600, a POS message 630 is transmittedto the terminal sales application 620 indicating the desire for the userto conduct a virtual transaction for order 452, where information fororder 452 resides in the distributed computing system 240 and an opticalmachine-readable representation 460 is generated by the terminal salesapplication 620 which is unique to each order 452. The opticalmachine-readable representation 460 is later transmitted to the mobiledevice 200 and displayed on the display 206.

In one embodiment, upon receiving the POS message 630, terminal salesapplication 620 generates a Virtual Terminal Sales Application (VTSA)640 for each virtual transaction conducted by each user 610. Each VTSA640 has its own unique identifier 462 generated for it, wherein eachVTSA 640 and each unique identifier 462 associated with it represent aunique order 452. Transaction state information 642 is maintained foreach VTSA 640 using the unique identifier 462. Upon generating a uniqueidentifier 462 for an order 452, the unique identifier 462 is thentransmitted to mobile device 200 via application 400 in the form ofoptical machine-readable representation 460, and also transmitted to thepoint of sale terminal 600, where the unique identifier 462 is used toidentify order 452 and a user 610 associated with unique order 452.

The self-checkout station, in addition the cashier's point-of-saleterminal, also uses transaction transfer to import the transaction stateusing optical machine-readable representation 460 encoding a uniqueidentifier 462 from the distributed computing system 240. The opticalmachine-readable representation 460 scanned from the mobile device 200with scanning machine 500 encodes the unique identifier 462 which isthen used by the point of sale terminal 600 to find the associated order452 that resides on the distributed computing system 240.

With reference to FIG. 20, a POS message 630 is generated as a result ofinput from a user 610 and received by terminal sales application 620,and specifically session manager 650, and a method 700 for maintainingand conducting a virtual transaction is initiated at block 702. Method700 is performed by terminal sales application 620 which resides on theserver 240. Upon initiating method 700 at block 702, the method 700awaits to receive a POS message 630. Upon receiving a POS message 630,method 700 then moves to block 704, whereupon it is determined if aunique identifier 462 or a unique mobile identifier (UMI) exists or notfor a particular virtual transaction being referred to by user 610within received POS message 630. If a unique identifier 462 or a uniquemobile identifier (UMI) does not exist, then one is created by sessionmanager 650 or retrieved from mobile device 200 by session manager 650at block 706. The unique identifier 462 or unique mobile identifier(UMI) is then associated with the virtual transaction and method 700moves from block 706 back to block 704. If a unique identifier 462 or aunique mobile identifier (UMI) does exist, then method 700 moves toblock 708, whereupon it is determined if a Virtual Terminal SalesApplication (VTSA) 640 is available for use. In one embodiment, aplurality of VTSAs 640 are operating within the terminal salesapplication 620, the plurality of VTSAs 640 referred to herein as a TSAPool 644. In this embodiment, at block 708, it is determined if a VTSA640 from TSA Pool 644 is available. If no VTSA 640 is available, thenmethod 700 moves to block 710 and waits.

If a VTSA 640 is available, then method 700 moves to block 712 andallocates a VTSA 640 for conducting a virtual transaction in relation tothe received POS message 630 and associated with the unique identifier462 or UMI. When the VTSA 640 is allocated, a new session of the VTSA640 is opened. Upon allocating a VTSA 640, method 700 then moves toblock 714, whereupon it is determined if transaction state information642 exists for the virtual transaction or not. If transaction stateinformation 642 does not exist for the virtual transaction, thentransaction state information 642 is initialized and generated at block716 and then the method 700 moves back to block 714.

If transaction state information 642 does exist for the virtualtransaction, then the method 700 moves to block 718, whereupon thetransaction state information 642 is retrieved and loaded into the VTSA640. If transaction state information 642 already existed and resides intransaction container 660, then the transaction state information 642 isretrieved from the transaction container 660 and loaded into the VTSA640 at block 718.

Upon loading the transaction state information 642 into the VTSA 640,the method 700 then moves to block 720, whereupon a transaction item,received within POS message 630, is added to or processed within thevirtual transaction by the VTSA 640. A transaction item is any portionof a virtual transaction, and includes such things as adding or removingan item 220 from virtual shopping cart 433, totaling items 220 withinvirtual shopping cart 433, a payment for all items 220, some items 220,one item 220, or a portion of one item 220 within virtual shopping cart433 or a specific virtual transaction, indicating a payment method foran item 220 within virtual shopping cart 433 or a specific virtualtransaction, or any other activity or bit of information associated withthe virtual transaction.

Upon processing or adding the transaction item using VTSA 640, method700 moves to block 722, whereupon the transaction state information 642is saved by VTSA 640 within the transaction container 660. Transactioncontainer 660 represents a location within a storage device for storingtransaction state information 642. Upon saving the transaction stateinformation 642, method 700 moves to block 724 and releases the VTSA 640back into the TSA Pool 644, and closing the open VTSA 640 session,making VTSA 640 available for use by session manager 650 to processanother request within a received POS message 630. Method 700 then movesback to block 702 and awaits the receipt of another POS message 630.

FIG. 22 is a block diagram illustrating an environment 2200 in which oneor more mobile devices 200 read one or more identifiers (e.g.,identifiers 2212, 2214, 2216, and 2218) associated with and/or affixedto geographically distributed physical objects 2202-2208 (e.g., physicalobjects A-D). The physical objects can be items (e.g. items 220 as shownin FIG. 1B) disposed in a retail store or facility. The mobile devices200 can execute a mobile self-checkout application (e.g. mobileself-checkout application 400 as shown in FIG. 3). The mobileself-checkout application can present the items of Scan Items (e.g. scanitems 412 as shown in FIG. 3) and the option of Begin Shopping (e.g.Begin Shopping 406 as shown in FIG. 3). In response to selecting theScan Items and/or Being Shopping, the mobile device 200 can scan theidentifiers associated with the physical objects.

Each of the physical objects 2202-2208 can be disposed in situ location(e.g., a resting or original location). Users 2205 a-b of the mobiledevices 200 may remove the physical objects that have been scanned bythe mobile devices 200 from their in situ locations. Each in situlocation can include like physical objects such that when one of thelike physical objects is removed from its in situ location by one user,another user may remove another one of the like objects from its in situlocation. The one or more mobile devices 200, can be configured to, scandifferent identifiers 2212-2218 of the different geographicallydistributed physical objects.

As non-limiting example of embodiments of the present disclosure, a user2205 a of mobile device 200 may scan (using the mobile device 200) theidentifiers 2212, 2214, 2216, and 2218 for the physical object A,physical object B physical object C and physical object D, respectively,in the aforementioned order and may remove an instance of the physicalobjects A-D from their original location. A user 2205 b of mobile device200 may scan the identifier 2218, 2216, 2214 and 2212 of physical objectD, physical object C, physical object B and physical object A,respectively, in the aforementioned order and may remove an instance ofthe physical objects A-D from their original location. As illustrated inFIG. 1B, the mobile devices 200 of users 2205 a-b can each transmit adata set to a distributed computing system 240. The data sets caninclude the different identifiers 2212-2218 and the order in which thedifferent identifiers 2212-2218 were scanned.

The distributed computing system 240 can be programmed to receive thedata sets from the mobile devices 200 of users 2205 a-b, and canretrieve the known in situ locations of the physical objects A-D basedon the different identifiers 2212-2218 included in the data sets.

The in situ location of at least one of the different geographicallydistributed physical objects A-D may be unknown. For example, thedistributed computing system 240 may retrieve the known in situ locationfor physical objects A, C and D; however, the in situ location forphysical object B may be unknown by the distributed computing system240. The distributed computing system 240 may generate paths(recreating/approximating a route traveled by the mobile devices basedon the scans) 2210 a-b of the mobile devices 200 of users 2205 a-b basedon the known in situ locations of the different geographicallydistributed physical objects A, C, and D. For example, the mobile device200 of user 2205 a scanned the identifier 2212 of physical object A,identifier 2216 of physical object C and identifier 2218 of physicalobject D in the respective order, and the distributed computing systemcan determine the path 2210 a of the mobile device 200 of user 2205 abased on the known in situ locations of physical object A, physicalobject C, and physical object D. That is, the distributed computingsystem 240 can determine that the path 2210 a of the mobile device 200of user 2205 a by determining that the mobile device 200 scanned theidentifier 2212 of physical object A before scanning the identifier 2214of physical object B and scanned the identifier 2216 of physical objectC and the identifier 2218 of physical object D after scanning theidentifier 2214 of physical object B.

Similarly, the distributed computing system 240 may generate a path 2210b of the mobile device of user 2205 b based on the mobile device 200 ofuser 2205 b scanning the identifier 2218 of physical object D,identifier 2216 of physical object C and identifier 2212 physical objectA. The distributed computing system 240 can generate the paths bymapping data points of scanned identifiers with known in situ locations.For example, the distributed computing system 240 can determine that themobile device 200 of user 2205 b scanned the identifier 2218 of physicalobject D, and the identifier 2216 of physical object C before theidentifier 2214 of physical object B and scanned the identifier 2212 ofphysical object A after scanning the identifier 2214 of physical objectB. Consequently, the distributed computing system 240 may determine thepath 2210 b of the mobile device 200 of user 2205 b. Using the paths(e.g., 2210 a and 2210 b), the distributed computing system 240 candetermine the in situ location of physical object B. For example, thedistributed computing system 240 can identify an intersection of thepaths and/or the physical objects that are nearest to the physicalobject B based on the order with which physical objects are scanned bymobile devices. In some embodiments, the distributed computing system240 can verify the accuracy of the determined location of physicalobject B by interpolating the in situ location as an added data point ata point along the path a data point representing the determined locationof physical object B, overlaying an existing map including a designatedlocation for physical object B over the data points and determining ifthe data points correlate with the designated location for physicalobject B on the existing map.

In exemplary embodiments, in response to determining the location ofphysical object B based on the paths (e.g., paths 2210 a-b), thedistributed computing system 240 can trigger one or more events. The oneor more events can include, for example, issuing an alert, storing thedetermined in situ location of a physical object having a previouslyunknown in situ location, determining a new location to move thephysical object. For example if physical object B is not supposed to beat the determined in situ location, an alert can be sent out to movephysical object B.

In exemplary embodiments, the distributed computing system can determinewhether a mobile device followed a logical path when scanning objects,and based on such a determination can choose to include or exclude theset of data from the mobile device. As one example, the distributedcomputing system can receive a set of data from a mobile device thatpreserves the order in which the objects were scanned. Upon retrievingknown in situ location for at least some of the objects and associatingthe known in situ locations with the order in which the at least some ofthe objects were scanned, the distributed computing system can determinethat followed an arbitrary, unplanned, or illogical path. Once thedistributed computing system determines that the mobile device did notfollow a logical path, the distributed computing system can omit the setof data from the mobile device from the process of determining the insitu locations from objects with unknown in situ locations. Conversely,based on the order in which the objects are scanned and the in situlocation of at least some of the objects, the distributed computingsystem can determine that the mobile device followed a methodical,planned, and/or logical path when scanning the objects. Once thedistributed computing system determines that the mobile device followeda logical path, the distributed computing system can include the dataset from the mobile device in the process for determining the in situlocations of object with unknown in situ locations.

In continuing the above example, with reference to FIG. 1, the mobiledevice 200 of user 2205 a can scan the identifiers 2214 of physicalobject B, identifier 2212 of physical object A, identifier 2218 ofphysical object D and identifier 2216 of physical object C in theaforementioned order. The mobile device 200 of user 2205 a can transmitthe identifiers to the distributed computing system 240. The distributedcomputing system 240 can receive the scanned identifiers and query thedatabase for the known in situ locations of the physical objectsassociated with the identifiers, and based on the order in which theobjects are scanned, the distributed computing system can determine thatthe mobile device 200 scanned the identifiers out of order (e.g., didnot progress along a logical path to collect the objects). For example,the distributed computing system can determine the known in situlocations for physical objects A, C, and D. Furthermore, the distributedcomputing system 240 can determine the mobile device 200 of user 2205 ascanned the identifier 2212 for physical object A before scanningidentifier 2218 for physical object D and subsequently scanned theidentifier 2216 for physical object C. The distributed computing system240 can determine the physical object A is disposed on the left ofphysical object D, and physical object D is disposed to the right ofphysical object C. Therefore, the distributed computing system 240cannot determine a path based on the order of the scans. The distributedcomputing system 240 can disregard the scans due to the inability todetermine a path.

In one application, exemplary embodiments of the present disclosure canbe implemented to locate a product in a retail store. Users 2205 a-b mayscan identifiers of products as using their mobile devices as the userswalk around the retail store. The products can be disposed in their insitu locations (e.g., locations within the retail store at which theproducts are disposed). Users 2205 a-b of the mobile devices 200 mayremove the products that have been scanned by the mobile devices 101from their in situ locations (e.g., by placing the products in thecart). The identifiers 2212-2218 may be an optical machine-readablerepresentation (as described above) such as a barcode, QR code or RFIDtag.

While an example embodiment has been described as using two paths todetermine the in situ location of a physical object having a previouslyunknown in situ location, exemplary embodiments of the presentdisclosure can utilize one or more paths determined based on scanscaptured by one or more mobile devices. For example, accuracy of thedetermined in situ location for a physically object can increase as thequantity of paths increases. For example, one hundred paths can providea more accurate estimate of the in situ location of an object than tenpaths.

FIG. 23 illustrates an exemplary network environment of the objectlocation tracking system 2350 in accordance with exemplary embodimentsof the present disclosure. In exemplary embodiments, the networkenvironment includes mobile devices 200 in communication with adistributed computing system 240 via a network 2315. The distributedcomputing system 240 may include a database 2310, a path generatingmodule 2320, a location finder module 2330 and an event module 2340. Thedatabase 2310 may store data including but not limited to: names ofphysical objects, locations of physical objects, and quantities ofphysical objects. The database 2310 may also store a map of a facilitywithin which the physical objects are disposed. The mobile devices 200can execute an instance of the terminal sales application. 640.

In an example embodiment, one or more portions of network 2315 may be anad hoc network, an intranet, an extranet, a virtual private network(VPN), a local area network (LAN), a wireless LAN (WLAN), a wide areanetwork (WAN), a wireless wide area network (WWAN), a metropolitan areanetwork (MAN), a portion of the Internet, a portion of the PublicSwitched Telephone Network (PSTN), a cellular telephone network, awireless network, a WiFi network, a WiMax network, any other type ofnetwork, or a combination of two or more such networks.

In exemplary embodiments, one or more mobile device 200 can include aprocessor 2370 and one or more readers such as an optical reader 202, anRFID reader 2360, and/or the like. The reader(s) 202, 2360 can beincluded in the one or more mobile devices 200 and/or can be astand-alone device that can be physical and/or electrically coupled tothe one or more mobile devices 200. As mentioned above, for embodimentsutilizing the optical reader 202, the optical reader 202 can beconfigured to read optical machine-readable representations (e.g.,barcodes, QR codes). For embodiments utilizing the RFID reader 2360, theRFID reader 2360 can be configured to read RFID tags. The one or moremobile devices 200, using the reader(s) 202, 2360, can be configured to,scan a different identifiers 112-118 (as shown in FIGS. 1A-B) of thedifferent geographically distributed physical objects. of a differentgeographically distributed physical objects.

The mobile device 200 may execute an instance of the terminal salesapplication 640. The terminal sales application 640 can trigger theoperation of the readers 202, 2360. The mobile devices 200 scan theidentifiers (e.g. identifiers 2212, 2214, 2216, and 2218 as shown inFIG. 22) associated with for the physical objects (e.g. physical objectsA-D) using the readers 202, 2360. The mobile devices 200, via theterminal sales application 640, can transmit data sets including thedifferent identifiers associated with the physical objects and the orderin which the identifiers are scanned to the distributed computing system240.

The distributed computing system 240 may receive the differentidentifiers associated with the geographically distributed physicalobjects from the mobile devices 200. The location finder module 2330within the distributed computing system 240 may query the database 2310for known in situ location of the physical objects based on thedifferent identifiers. The in situ location of at least one of thedifferent geographically distributed physical objects may be unknown.The location finder module 2330 may communicate the known in situlocations of physical objects to the path generator module 2320. Thepath generator module 2320 may generate a path of the mobile devices 200based on the known in situ locations of the different geographicallydistributed physical objects and based on the chronological order of thescans the identifiers of mobile devices 200. The path generator module2320 may communicate the generated paths for the mobile devices 200 tothe location finder module 2330.

The location finder module 2330 may determine the in-situ location forphysical object for which the in situ location is unknown, using theprojected paths of the mobile devices 200. For example, the locationfinder module 2330 may place data points for the scanned identifiers bythe mobile devices 200 with the known in-situ locations and correlatethe data points to the generated paths. The location finder module 2330may determine the location of the physical object for with the in situlocation is unknown, based on the projected paths of the mobile devices200 and the data points based on the scanned identifiers. The locationfinder module 2330 can verify the accuracy of the determined locationphysical object for which the in situ location was unknown, byinterpolating the in situ location as an added data point at a pointalong the projected path a data point representing the determinedlocation the physical object, overlaying an existing map including adesignated location for physical object over the data points anddetermining if the data points correlate with the designated locationfor physical object on the existing map.

In exemplary embodiments, in response to determining the location thephysical object, the event module 2340 can trigger an event. The eventis one or more of, issuing an alert, storing the determined location ofthe at least one physical object, determining a new location to move thephysical object. For example, physical object is not designated to be atthe determined location, an the event module 2340 may send an alert tomove the physical object to the designated location.

FIG. 24 is a flowchart illustrating an exemplary process in accordancewith exemplary embodiments of the present disclosure. In exemplaryembodiments, in operation 2400 scanning, via one or more mobile devices(e.g., mobile devices 200 shown in FIGS. 1B-1C and 3-23) of users (e.g.,users 2205 a-b shown in FIG. 22) different identifiers (e.g.,identifiers 2212-2218 shown in FIG. 22) of different geographicallydistributed physical objects (e.g., physical objects A-D shown in FIG.22). The mobile devices can be executing a terminal sales application.The mobile devices are communicatively coupled to a distributedcomputing system (e.g., the distributed computing system 240 shown inFIGS. 1B, 22 and 23). For example, mobile devices can be used to scanthe identifiers of physical objects. The identifiers may be opticalmachine readable representations such as barcodes, QR codes or RFIDtags.

In operation 2402, the mobile devices can transmit data sets includingthe different identifiers that were scanned and the order in which theidentifiers were scanned to the distributed computing system. Inoperation 2404, the distributed computing system can receive thedifferent identifiers for the different geographically distributedphysical objects. In operation 2406, the location finder module withinthe distributed computing system can query the database for known insitu locations of the physical objects based on the differentidentifiers included in each of the data sets. The database may storedesignated location information associated physical objects. Inexemplary embodiments, a location of a physical object associated withan identifier included in the data sets can be unknown such that thedistributed computing system may be unable to retrieve and/or identifythe location of physical object from the database.

In operation 2408, the path generator within the distributed computingsystem can generate paths that the mobile devices traversed when theyscanned the different identifiers based on the known locations ofphysical objects and an order in which the identifiers were scanned.

In operation 2410, the location finder module within the distributedcomputing system may determine the in-situ location of the physicalobject having a previously unknown in situ location based on thegenerated paths. For example, the known locations of physical objectscan be placed as data points on a map, while the location for physicalobject may remain unknown. The distributed computing system candetermine that the physical object having the unknown in-situ locationis located between certain physical objects in the data sets based onintersections of the paths of the mobile devices and/or the locations ofthe physical objects corresponding the identifiers that were scannedimmediately previous to and/or immediately after the physical objecthaving the unknown in situ location is scanned.

In some embodiments, in response to determining a location of thephysical object having a previously unknown location, the distributedcomputing system may verify the location is a where the physical objectis supposed to be disposed. The distributed computing system maygenerate a projected path by placing data points at the known locationof physical objects. The distributed computing system may overlay a mapof a facility on the data points to verify the location of physicalobject.

In some embodiments, in response to determining the location of physicalobject, an event module within the distributed computing system maytrigger an event. The event may be to query the database using thelocation and determine if another physical object belongs in thelocation. In other embodiments, the distributed computing system maystore the location of physical object in the database. In describingexemplary embodiments, specific terminology is used for the sake ofclarity. For purposes of description, each specific term is intended toat least include all technical and functional equivalents that operatein a similar manner to accomplish a similar purpose. Additionally, insome instances where a particular exemplary embodiment includes aplurality of system elements, device components or method steps, thoseelements, components or steps may be replaced with a single element,component or step. Likewise, a single element, component or step may bereplaced with a plurality of elements, components or steps that servethe same purpose. Moreover, while exemplary embodiments have been shownand described with references to particular embodiments thereof, thoseof ordinary skill in the art will understand that various substitutionsand alterations in form and detail may be made therein without departingfrom the scope of the present invention. Further still, other aspects,functions and advantages such as different combinations of the describedembodiments are also within the scope of the present invention.

Exemplary flowcharts are provided herein for illustrative purposes andare non-limiting examples of methods. One of ordinary skill in the artwill recognize that exemplary methods may include more or fewer stepsthan those illustrated in the exemplary flowcharts, and that the stepsin the exemplary flowcharts may be performed in a different order thanthe order shown in the illustrative flowcharts.

We claim:
 1. A system comprising: a distributed computing system; one ormore mobile devices communicatively coupled to the distributed computingsystem, including a processor and an optical reader, one or more of themobile devices being configured to (i) scan a plurality of differentidentifiers of a plurality of different geographically distributedphysical objects, and (ii) transmit the plurality of differentidentifiers to the distributed computing system; wherein the distributedcomputing system is programmed to: receive the plurality of differentidentifiers for the plurality of different geographically distributedphysical objects; query a database for known locations of the pluralityof different geographically distributed physical objects using theplurality of different identifiers, wherein a location of at least oneof the plurality of different geographically distributed physicalobjects is unknown; interpolate each of the known locations of theplurality of different geographically distributed physical objects as adata point; retrieve a map of a facility in which the plurality ofdifferent geographically distributed physical objects are designated tobe disposed from the database; overlay the map including locations atwhich each physical object of the plurality of different geographicallydistributed physical objects are designated to be disposed, over thedata points representing each known location of the physical objects;determine whether the data points representing each of the knownlocations of each of the physical objects correlate with the designatedlocations of each physical object; generate one or more projected pathsof the one or more of mobile devices based on the data points, whereingenerating the one or more projected paths includes omitting at leastone data point determined to be arbitrary, unplanned, or illogical; anddetermine the location of the at least one physical object based on anintersection of two or more of the projected paths.
 2. The system ofclaim 1, wherein in response to determining a location of the at leastone physical object, verify the location is where the physical object issupposed to be disposed.
 3. The system in claim 1, wherein in responseto determining the location of the at least one physical object based onan intersection of two or more of the projected paths the distributedcomputing system triggers an event.
 4. The system in claim 3, whereinthe event is one or more of: issuing an alert, storing the determinedlocation of the at least one physical object, determining a new locationto move the physical object.
 5. The system in claim 1, wherein themobile device is one or more of: a mobile phone, a portable digitalassistant, a laptop computer, a tablet device, or a wireless portabledevice.
 6. A method comprising: scanning, via one or more mobile devicescommunicatively coupled to a distributed computing system, including aprocessor and an optical reader, a plurality of different identifiers ofa plurality of different geographically distributed physical objects;transmitting, via the one or more mobile devices, the plurality ofdifferent identifiers to the distributed computing system; receiving,via the distributed computing system, the plurality of differentidentifiers for the plurality of different geographically distributedphysical objects; querying, via the distributed computing system, adatabase for known locations of the plurality of differentgeographically distributed physical objects using the plurality ofdifferent identifiers, wherein a location of at least one of theplurality of different geographically distributed physical objects isunknown; interpolating, via the distributed computing system, each ofthe known locations of the plurality of different geographicallydistributed physical objects as a data point; retrieving, via thedistributed computing system, a map of a facility in which the pluralityof different geographically distributed physical objects are designatedto be disposed from the database; overlaying, via the distributedcomputing system, the map including locations at which each physicalobject of the plurality of different geographically distributed physicalobjects are designated to be disposed, over the data points representingeach known location of the physical objects; determining, via thedistributed computing system, whether the data points representing eachof the known locations of each of the physical objects correlate withthe designated locations of each physical object; generating, via thedistributed computing system, one or more projected paths of the one ormore of mobile devices based on the data points, wherein generating theone or more projected paths includes omitting at least one data pointdetermined to be arbitrary, unplanned, or illogical; and determining,via the computing system, the location of the at least one physicalobject based on an intersection of two or more of the projected paths.7. The method of claim 6, further comprising in response to determininga location of the at least one physical object, verifying, via thedistributed computing system, the location is where the physical objectis supposed to be disposed.
 8. The method in claim 6, further comprisingin response to the distributed computing system determining the locationof the at least one physical object based on an intersection of two ormore of the projected paths, triggering, via the distributed computingsystem, an event.
 9. The method in claim 8, wherein the event is one ormore of: issuing an alert, storing the determined location of the atleast one physical object, determining a new location to move thephysical object.
 10. The method in claim 6, wherein the mobile device isone or more of: a mobile phone, a portable digital assistant, a laptopcomputer, a tablet device, or a wireless portable device.
 11. One ormore non-transitory computer readable memory media storing instructions,wherein the instructions are executable by one or more processors to:scan, via one or more mobile devices communicatively coupled to adistributed computing system, including a processor and an opticalreader, a plurality of different identifiers of a plurality of differentgeographically distributed physical objects; transmit, via the one ormore mobile devices, the plurality of different identifiers to thedistributed computing system; receive, via the distributed computingsystem, the plurality of different identifiers for the plurality ofdifferent geographically distributed physical objects; query, via thedistributed computing system, a database for known locations of theplurality of different geographically distributed physical objects usingthe plurality of different identifiers, wherein a location of at leastone of the plurality of different geographically distributed physicalobjects is unknown; interpolate, via the distributed computing system,each of the known locations of the plurality of different geographicallydistributed physical objects as a data point; retrieve, via thedistributed computing system, a map of a facility in which the pluralityof different geographically distributed physical objects are designatedto be disposed from the database; overlay, via the distributed computingsystem, the map including locations at which each physical object of theplurality of different geographically distributed physical objects aredesignated to be disposed, over the data points representing each knownlocation of the physical objects; determine, via the distributedcomputing system, whether the data points representing each of the knownlocations of each of the physical objects correlate with the designatedlocations of each physical object; generate, via the distributedcomputing system, one or more projected paths of the one or more ofmobile devices based on the data points, wherein generating the one ormore projected paths includes omitting at least one data pointdetermined to be arbitrary, unplanned, or illogical; and determine, viathe computing system, the location of the at least one physical objectbased on an intersection of two or more of the projected paths.
 12. Theone or more non-transitory computer readable media of claim 11, whereinin response to determining a location of the at least one physicalobject, execution of the instructions by the one or more processorscauses the one or more processors to verify the location is where thephysical object is supposed to be disposed.
 13. The one or morenon-transitory computer readable media of claim 11, wherein in responseto the distributed computing system determining the location of the atleast one physical object based on an intersection of two or more of theprojected paths, execution of the instructions by the one or moreprocessors causes one or more processors to trigger an event.
 14. Theone or more non-transitory computer readable media of claim 13, whereinthe event is one or more of: issuing an alert, storing the determinedlocation of the at least one physical object, determining a new locationto move the physical object.